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ABSTRACT 

The Diablo Valley College (California) Research 
Office assessed the variation of grades in multiples-section courses 
anri its impact on the ability to predict student success. All classes 
selected for the study were general education off-srings applicable 
for the Associate of Arts degree and/or transfer, and were taught by 
more than one instructor. A grade point average (GPA) was computed 
for each instructor with an A grade equal to 4 points, B=3, C=2, D=l , 
and F=0 and W (withdrawal) =1 . The GPA's were compared for all 
instructors in each class, and variation was calculated once with W's 
included and once with W's excluded. Including W's, instructor GPA's 
varied by a low of 0.67. for an administration of justice course to a 
high of 18. 1% for an anthropology course* Excluding W's, grade 
variations ranged from 0*2% for a history course to 237. for a physics 
course. Grading variation for a course did not appear to depend on 
the number of instructors teaching the course* Other predictor 
variables examined in the regression analyses of selected courses 
included student age, gender, ethnicity, educational level, work 
hours, cumulative GPA in other courses, and high school GPA. The 
study report includes graphs showing the results of regression 
analyses for particular courses. (ECC) 
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INSTRUCTOR GRADING VARIATION AND ITS IMPLICATIONS 

FOR 

ASSESSMENT, ADVISING, AND ACADEMIC STANDARDS 



The Diablo Valley College Research office is evaluating the variation of grades In multi-section 
courses and how this affects the ability to predict student success, (see the attached Table 1 of 55 
courses) 

SELECTION PROCESS 

Must be a multi-section course. 

Must have more than one instructor teaching the course. 

Must be GE applicable for the AA degree and/or transfer. 

ANALYSIS 

An Instructor's GPA was calculated by using the students grades forthat instructor with A=4, B=3, 
C==2. D=1, and F=9 (W=0 when it was used). 

The GPA's were compared across instructors for each course and the R was calculated, first with 
the W's included (Grade 1 by Instructor) and then with the W's excluded (Grade 2 by Instructor). 

The table also shows the minimum GPA, the maximum GPA, and the range between the minimum 
and maximum. 

The * Indicates the was significant at the 0.05 level or better. 

FINDINGS 

The for grades including W's varied from 0.6% to 1 8. 1 %. 
The R^ for grades excluding W's varied from 0.2% to 23%. 

The size of the does not appear to be dependent on the number of Instructors. For exampl^ 
Anthr 130 has the largest with only four instructors and Engl 123 with 21 instructors has an R 
of 13.1% but Spch 120 also with 21 instructors has an R^ of 4.1%. 

QUESTIONS 

What are some of the reasons for the variation in grades? 
What should be a reasonable goal for the value of R 
What should be a reasonable goal for the range value? 



A:\acctVns_var1 
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DVC Research Office 



Table 1: Instructor Vanation in Grading in 55 DVC Courses 
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1 
















































Gradel by Instructor 




Grade2 by Instructor 




Course 


Stdt. f^S 


Instr. N 


R oQ. 




Min UrA 1 


viax Or A 


Rnnan 


ri oq. 




Min GPA 1 


Viax GPA 


Range 


Anthr. 1 30 


284 


4 


1 O.I % 




1 .oy 


O.OD 


1 .87 


11 POA 


• 


2.56 


3.56 


1.00 


Ad.Jus. 1 20 


. 421 


5 


U.bTT) 




1 QQ 
1 .OO 


9 '59 
Z.oZ 


0.44 


A d% 

f TO 


it 


2.26 


3.15 


0.89 


Astro. 1 10 


41 5 


z 


/ .y 7W 


• 


1 AR 
1 .DO 


9 J.R 


0.80 


O . U 




2.11 


2.80 


0.69 


DiO.bC. lUl 


Zoo 


o 


Q 9 

y .z 7T) 


• 


1 in 




1.26 




• 


2.00 


2.73 


0.73 


DiO.oC. 1 


con 


1 9 


1 n fictf, 

1 U.D vtJ 


• 




OO 


1 .92 


1 1 .7% 


• 


1.62 


3.26 


1.64 






C 

u 




• 


1 .90 


^ . f o 


1.20 


1 4.6% 


• 


2.U. 3.47 


1.32 


bus. loO 


7 1 R 
/ 1 O 


o 
o 


D . 0 TO 


• 


1 1 Q 


^ . O V 


1.17 


4.5% 


• 




no 


0.81 


Lnem. lUo 


*y \ D 


1 1 
1 1 


O. / VT) 


• 


1 1 Q 


9 4R 


1.27 


U . O /D 


* 


9 n? 


? 97 


1.20 


Lrriern. i 


ZD4 


c 
D 


b.4% 




1 99 
1 .OZ 


9 RR 
Z.DO 


1.24 


\ 0.\J 70 


* 


9 9R 
Z.ZO 


7 AR 


1.19 


LOm.bC. lU 


Q.A'i 

b4o 


7 


o.y TV 




1 R9 


2.4G 


0.93 


1 n 1 % 

1 U. 1 /O 


* 


1 on 
1 .yu 


9 1 R 


1.25 


fccon. Z20 


/ 1 1 


/ 


4.b% 


• 


1 97 

1 .z / 


9 no 

z.uy 


0.82 


9 QQZ, 




9 11 

z. 1 1 


9 QR 
Z.OO 


0.74 


Econ. 221 


2/1 


4 


3.7% 




1.82 


2.43 


0.61 


9 CGZ. 

o.bTb 




9 9/1 
Z.o4 


9 Q 9 
Z.OO 


0.49 


Engl. 96 


1 52 


7 


14.5% 




1.09 


2.62 


1 .53 


ZZ.Z% 




1 C Q 

1 .by 


o.Zo 


1.64 


Engl. 98 


155 


7 


2.7% 




1.73 


2.56 


0.83 


C C Q/ 

b.b% 




2.50 


0. / 1 


1.21 


Engl. 116 


336 


10 


1.9% 




1.79 


2.59 


n fin 


5.6% 




2.05 


0.41 


1..'^6 


Engl. 118 


774 


23 


10.1 % 




1.45 


3.76 


9 '^1 

^ . O 1 


13.2% 




1 .7 1 


0.76 


2.05 


Engl. 122 


2148 


47 


13.9% 


• 


1.0O 


3.56 


9 RR 


16.2% 




1 .56 


3.63 


2.07 


Engl. 123 


742 


21 


13.1% 




I.Va 


3.78 


£. .UO 


1 4.4% 




2.00 


3.0b 


1 .85 


Engl. 126 


640 


13 


12.5% 




1.00 


3.08 


.\JO 


16.6% 




1 .80 


0 A C 

o,4b 


1 .58 


Fam.LI. 124 


519 


u 


8.2% 




1.S7 


3.05 


1 1 p< 


1 5.8% 




9 9 
Z. 1 0 




1 .34 


Geog. 120 


366 


2 


0.7% 




2.24 


2.48 
2.55 




1 .7% 




9 K/l 
Z.b4 


9 QK 
Z.Ou 


0.31 


Geo!. 120 


390 


4 


1 3.6% 




1.301 


1 9R 


n c n/ 
9.5% 




1 .OD 




0.98 


H. Sci. 124 


1071 


10 


1 7.2% 




1.23! 3.59 


2.36 


n 9 Q/ 
ZZ.OTb 




1 RR 


7R 
0 . / 0 


2.20 


Hist. 1 20 


1 076 


10 


11.1% 




1 .04 


2.54 


1 .50 


1 O QO^ 

1 Z.y 




1 .63 


2.90 


1.27 


Hist. 121 


458 


o 

o 


9.7% 




0.93 


2.70 


1 .77 


R ROA 

b.b % 


• 


1 RR 


9 <^9 


1.34 


Hist. 122 


1 73 


2 






2.05 


2.38 


0.33 


U.Zto 




2.43 


2.53 


0.10 


Hist. 1 24 


249 


3 


COO/ 
O.OVO 




1.65 


2.60 


0.95 


0.3 70 


• 


1 .95 


2.98 


1.03 


Human. 10b 


4o 1 


e 
O 


Q 1 0|A 
O. 1 % 


• 


1.69 


3.50 


1 .81 


y.j A) 


• 


9 94 


3.77 


1.53 


Matn / 1 


□ Q 

byo 


1 u 


D.Z 7D 


* 


1.01 


2.35 


1 .34 


1 7 R% 
1 o.o /o 


• 


1 .0 1 


1. 1 9 


1.81 


Matn 1 1 U 


QK 9 

y oz 


1 Q 

1 o 


D. / A) 


* 


1.19 


2.56 


1 .37 


1 A 4% 


• 


1 RR 
1 .DO 


'^R 


1.80 


Matn 1 zu 


1 n 1 Q 

1 U 1 O 


9 1 

Z 1 


D.U 7b 




1.03 


2.63 


1.60 


tl.O /D 


« 


1 Rn 


o.\^o 


1.43 


Mam I z 1 




o 
o 


O. / 7b 




0.77 


2.53 


1.76 


1 R 

1 U.O /u 


• 


1 R7 
1.0/ 


o.ou 


1,63 


Kilfxth 1 9A 

iviain 1 z** 


O 1 


7 


O .O 7T) 




1.36 


2.07 


0.71 


R% 

O . V /u 


• 


1 fl9 
1 .0^ 


9 Qn 


1.08 


Mam 1 oo 


1 1 A 


A 


A A9L 




1.35 


2.32 


0.97 


O.I /u 




9 OA 


9 79 


0.64 


Math 1 4.9 




1 1 

1 1 


7 ROA 


• 


1.43 


2.95 


1.52 


O 7v 


• 


^ . 0^ 


41 
0 . ^ t 


1.02 


fkif^th 1 A 1 

iviain 1 o \ 


1 / 0 


r; 
o 


4.U 7b 




1.39 


2.19 


0.80 


R 9% 

D.Z A) 




2.03 


2.9 1 


0.88 


Mam 1 y i 


9 1 R 
Z 1 O 


D 


y| CO/. 
4.b TO 




1.09 


2.03 


0,94 


O.Z TO 




2.14 


2.68 


0.54 


Matn 1 yz 


y1 O O 

4oZ 


1 o 
1 Z 


A O 0/ 

4.0% 




1.59 


2.77 


1.18 


4.y TO 




2.35 


3.25 


0.90 


Math 193 


217 


c 
D 


7.7% 




1.43 


2.73 


1 .30 


7 9oA 
/.07b 




2.75 


3.39 


0.64 


MUSIC 1 10 


oOy 


A 

4 


1 .4% 




2.36 


3.15 


0.79 


1 9 0^ 
1 .070 




2.57 


3.15 


0.58 


P.E. 121 


481 


7 


A CO/ 

4.(5% 


« 


2.20 


3.M 


0.94 


1 n 7QA 

1 0. / to 


• 


2.59 


3.67 


1 .08 


P.E. 1 24 


992 


1 2 


6.2% 




2.00 


3.59 


1 .59 


1 1 QOA 

1 z.y% 


• 


2.49 


3.88 


1.39 


P.E. 126 


670 


o 
O 


CIO/ 

b. 1 70 


• 


1.50 


3.00 


1 RD 
1 . ov 


b.O TO 


• 


3.11 


3.82 


0.7 1 


Phy.Sc. 1 1 2 


1 65 


z 


10.3% 


• 


1.69 


2.55 


0.86 


15.2% 


• 


2.26 


2.97 


0.72 


Phys. 110 


zoy 


4 


9.2% 


• 


1.53 


2.78 


1 .25 


16.9% 




1.91 


3.36 


1.46 


Phvs 1 20 


1 24 


5 


1 1.5% 


« 


1.47 


3.00 


1 .53 


12.9% 




2.59 


3.69 


1.10 


Phys. 1 30 


116 


4 


6.2% 




1.48 


2.54 


1.06 


23.0% 


• 


2.29 


3.59 


1.30 


Pol.Sc. 120 


348 


5 


b.4% 


• 


1.05 


2.16 


1.11 


8.4% 


• 


1.73 


2.78 


1.05 


Pol.Sc. 121 


281 


4 


1.0% 




1.52 


1.95 


0.43 


3.4% 




1.89 


2.56 


0.67 


Psych. 122 


1523 


15 


4.8% 




2.04 


3.21 


1.17 


5.1% 


• 


2.64 


3.43 


0.79 


Psych. 210 


882 


S 


7.2% 


• 


1.90 


3.29 


1.39 


8.7% 


• 


2.30 


3.55 


1.25 


Psych. 220 


206 


2 


1.5% 




2.36 


2.76 


0.40 


3.3% 




2.94 


3.33 


0.39 


Soc.Sc. 1 10 


302 


5 


12.6% 


• 


1.58 


3.33 


1.75 


12.9% 


• 


2.18 


3.53 


1.35 


Socio. 120 


366 


3 


5.2% 


• 


1.95 


2.72 


0.77 


4.5% 


• 


2.33 


2.96 


0.63 


Spch. 120 


134E 


21 


4.1% 


• 


1.57 


3.17 


1.6C 


6.2% 


• 


2.35 


3.62 


1.27 



VARIABLES EXAMINED IN THE REGRESSION ANALYSES 

OF 



SELECTED COURSES 


PREDICTOR VARIABLES 


ENTERING STUDENTS^ 
Age (log function) 
Gender 

Ethnicity (White/Nonwhite) 
Educational Level^»^ 
Work Hours^ 
Cumulative GPA in Other 
Courses^ 


CONTINUING STUDENTS 

Age (log function) 

Gender 

Ethnicity (White/Nonwhite) 
Educational Level^*"^ 
V>fork Hours^ 
Cumulative GPA in Other 
Courses'^ 


High School GPA (self reported) 
Total Score on the APS English Test 




Instructor GPA 
(excluding W's) 


instructor GPA 
(excluding W's) 



OUTCOME VAHIABLE 
Grades (excluding W's) Grades (excluding W's) 



1 . Entering students include first time fr6)shmen or transfer and returning students 
with less than 12 units. 

2. On a scale of 1-8, where 1 = first time freshman and 8 = PHD Degree. 

3. At the time of application to the college. 

4. This excludes students who enrolled in no other courses that contributed to 
their DVG GPA. 

A:\acct\ins_var2 
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REGRESSION ANALYSIS FOR 
BIOSC 102 

Entering Students 




Instructor GPA 



Instructor GPA 
Only 




48.4% 



Student & Instructor 
Variables 



Other Variables 



SoiKwFalMCM* 

HTM 

K^^j»^ (Excludes W grades) 



8 



REGRESSION ANALYSIS FOR 
BIOSC102 

Continuing Students 




Instructor GPA 



Instructor GPA 
Only 




Bourot: PaH ^ Data 
Vim 



(Excludes W grades) 
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REGRESSION ANALYSIS FOR 
BUS 109 

Entering Students 




Instructor GPA 



instructor GPA 
Only 




8ouro«: F*ll 92 D«(a 



(Excludes W grades) 
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REGRESSION ANALYSIS FOR 
BUS 109 

Continuing Students 




instructor GPA 



Instructor GPA 
Only 




Soum: Fan 92 
V2/W 

A:Vac(A^_butC 



(Excludes W grades) 
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REGRESSION ANALYSIS FOR 
HISTORY 120 

Entering Students 




1 1 .2% 




□ 



Student Variables 

Age (log function) 

Educational Level 

High School GPA 

Cum Gpa ir. other 
DVC courses 

Total score on APS 
English test 



47.3% 



student & Instructor 
Variables 



| ; . .| Other Variables 



(Excludes W grades) 
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REGRESSION ANALYSIS FOR 
HISTORY 120 

Continuing Students 




4.4°/c 



Instructor GPA 
Only 



40.7% 




Student Variables 

Age (log function) 
Ethnicity 
Work Hours 
Educational Level 

Cum GPA in other 
DVC courses 



54.9% 



Student & Instructor 
Variables 



Other Variables 



(Excludes W grades) 
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REGRESSION ANALYSIS FOR 
ENGLISH 122 

Entering Students 



84.6% 




75.2% 



Instructor GPA 



Instructor GPA 
Only 



13.3% 




11.5% 



Student Variables 

Gondar * 

Cum GPA In other 
DVC courses * 

Total score on APS 
English test 



Student & Instructor 
Variables 



Other Variables 



These variables are negatively correlated with final grade. 



A;\««\f^.«o9e (Excludes W grades) 
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REGRESSION ANALYSIS FOR 
ENGLISH 122 

Continuing Students 




Instructor GPA 



Instructor GPA 
Only 




Student & Instructor 
Variables 




Other Variables 



* This variable is negatively correlated with final grade, 

Bourc*: Fal020«(t 

A!v^f»g.t«ac (Excludes W grades) 
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CORRELATIONS BETWEEN TEST SCORES 
AND FINAL GRADES (excluding W's! 
IN ENGLISH 122, FALL 1992 
CONTROLLING FOR INSTRUCTOR GRADING VARIATION 





IN = 709) 






(N = 76) 


Statistic 


APSCC Tost Scores 




Writing 




Total 


Reading 


Writing 


Sample 


r (xy) 


.263 


.183 


.299 


.180 


r (xz) 


-.004 


-.028 


.028 


-.038 


r(vz) 


.361 


.361 


.361 


.389 


r (xy.z) 


.284 


.207 


.310 


.211 


SD 


11.20 


6.73 


5.65 


1.77 


sd 


9.61 


5.84 


4.89 


1.76 


R (xy.z) 


.326 


.237 




.213 



;:Not€s: ' ' i 

Final grades were coded so that A = 4, B = 3, C = 2, D = 1 and F = 0. 

r (xy) = the correlation between test score (x) and final grade (y) in the sample. 

** r (xy) is significant at the p<.05 level; * r is significant at the p<.10 level, 
r (xz) = the correlation between test score (x) and instructor GPA (z). 
r (yz) = the correlation between final grade (y) and instructor GPA (z). 
r (xy.z) = correlation between test score and final grade, controlling for instructor GPA. 
SD = the standard deviation of the unrestricted range of test scores, 
sd = the standard deviation of the restricted range of test scores in the sample. 
R (xy.z) = the correlation between te^t score and final grade, corrected for restriction 

of range in test scores and for instrictor grading variation. 

Shaded R's meet the .35 predictive validity standard Tor assessment instruments 

set by the California Community Colleges Chancellor's Office. 
N = sample size on which the statistical results are based. 
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